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SOME RECENT IDEAS IN RESEARCH METHODOLOGY: 
FACET DESIGN AND THEORY OF DATA 



Philip J. Runkel 



The purpose of this paper is to describe very briefly a couple of 
particular ways of thinking about research methodology. Hy selection of 
these ways of thinking is purely arbitrary, but I have chosen these par- 
ticular ideas because first, I consider them very powerful ideas and sec- 
ond, they are not yet being widely taught and are, therefore, not easy to 
come by. Not only do these ideas help those familiar with them to make 
comparisons and selections among the plethora of methods being used in 
current research, but in my opinion these ideas will come more and more 
to be used as tools by those who will be developing still further methods 
to replace those with which we have become dissatisfied. 

Each of the two schemes of thought which I shall present is very 
simple in its basic structure, though very extensive and complicated in 
its implications. The first idea is that of facet design and analysis 
originated by Louis Guttman, director of the Israel Institute of Applied 
Social Research. Bobbs-Merrill will soon publish a prelimiary edition 
of a book by Guttman about facet design and analysis, but until that book 
appears the only published information about this idea is to be found in 
scattered articles. The second idea is the theory of data of Clyde H. 
Coombs of the Psychology Department at the University of Michigan. Most 
of the structure so far worked out for this theory of data is now con- 
tained in a book which appeared in 1964. Obviously, only the briefest 
of introductions to each of these ideas can be contained ip this paper. 

A bibliography idiich can be pursued if either of the ideas strike you as 
useful will be found at the end of the paper. 
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FACET DESIGN AND ANALYSIS 

Facet design is a way of laying out a domain for research. Although 
it produces hypotheses, its special power as a tool resides in the fact that 
it enables one to specify the boundaries and structure of the entire domain 
of relevance within which one may wish to experiment. Facet analysis then 
enables one to test the validity of one’s assessment of the entire domain 
before he invests great time and money in experiments upon portions of the 
domain. But I have fallen into rather abstract phrases. In order to turn 
to a more. concrete way of speaking, let me take a couple of paragraphs to 
set the stage with a few familiar features of experimental design. 

In designing an experiment, one of the most nagging problems is 
whether we have chosen (a) relevant variables to be allowed to vary and 
(b) relevant variables to be controlled. That is, our hypotheses typical- 
ly take this form; under what conditions will values of a certain (depen- 
dent) variable be higher and utnder what conditions will the values be 
lower? For example, we might ask under what conditions teachers will stay 
longer in a school and under what conditions teachers will cut short their 
stay. We might feel that the amount of communication of some certain kind 
within the faculty would be related to length of service -- and we might, 
therefore, produce or look for schools in which there were conditions of 
low, medium, and high communication. For purposes of economy in research, 
we might want to rule out the effects of other conditions which we felt 
would also have an effect on length of service. We might believe that 
salary levels would be related to length of service but, if we were pri- 
marily interested in the effects of communication, we would either random- 
ize salary levels among our subjects or we would examine length of service 
within groups of teachers having salary levels relatively the same. The 
point is that we would pay attention in one way or another bo^ to commun- 
ication levels and salary levels (as well as other variables we think might 
be relevant) and the conclusions we would draw from our study would neces- 
sarily be circumscribed by these relevant variables. If we hold a variable 
constant at one level, then our conclusions must speak of our findings 
within this particular slice of total domain. If we select subjects 
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randomly from among a certain set of conditions, then our conclusions are 
complete only if they state that we have ignored the effects of this vari- 
able (which we think might have had effects had they been allowed to show). 
To repeat, we begin a study by trying to become aware of ;die variables 
.HI in circumscribing the domain which we want to study. 

It is not easy to become aware of the variables which put the 
"boundaries” on the domain we want to study. One of the difficulties is 
the ever-present bias on the part of the experimenter toward his own par- 
ticular ways of looking at the world. Selecting variables (a) to be ex- 
amined, (b) to be randomized, and (c) to be ignored typically becomes a 
matter of intuition instead of a systematic sequence of deliberate deci- 
sions. Another difficulty arises from the very technique of randomiza- 
tion in assigning subjects to experimental conditions. Randomizing rules 
out from observation the effects not only of variables which we are aware 
might be relevant but also the effects of those of which we are unaware. 
Ifliat we need is some method which will enable us to be systematic in 
thinking about the domain which we are setting out to study. 

The beginning logic of facet design is extremely simple; it is 
simply that of the Cartesian coordinates you used when you drew graphs 
in algebra class in junior high school. The chief differences are (a) 
that we do not always deal in the social sciences with numerical quanti- 
ties along the coordinates and (b) we typically deal with many more 
coordinates than we were able to put on the graph in junior high school. 

To be more exact, we might list at the left-hand side of a page 
some conditions of one sort and across the bottom of the page some con- 
ditions of another sort. By drawing horizortal and vertical lines, we 
would then have a grid of cells. Each cell would be designated by a 
particular condition of the one sort and a particular condition ox the 
other sort. For example, we might list levels of communication up the 
left side of the page and levels of salary across the bottom of the ^ 
page; ia a particular cell we would then enter observations of length 
of service on the part of those teachers who were characterized by that 
particular salary level and that particular amount of communication in 
their school. Comparisons of length of service in relation to level of 
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communication with salary held constant could then be made up and down a 
column of the diagram, while comparisons of length of service in relation 
to salary levels with level of communication held constant could be made 
left and right along the rows of the diagram. Comparisons taking into 
account both communication and salary would be made diagonally. In this 
example, communication is one facet and the various levels of communica- 
tion are the elements of that facet. Salary is the other facet. The var< 
iable of length of service is, of course, the dependent variable and the 
values of this variable constitute what Guttman calls the ’’range.” 

Taking this example a little farther, let us suppose for the sake 
of illustration that we predict that length of service will be longer 
where levels of communication are higher and also where salaries are 
higher. We would then expect that the average length of service would 
increase in the cells reading from left to right along a row and would 
also increase in the cells running from bottom to top in a column. Fur- 
thermore, we would predict that the average length of service in any 
particular cell would be higher than in cells to the ’’southwest” of it. 

On the other hand, we would not be able to predict the relative magni- 
tudes to be found in cells to the northwest or southeast because the ele- 
ments corresponding to those cells would be lower in one facet but higher 
in the other and therefore incomparable. Facet design does not lay out 
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predictions about all possible comparisons among the sets of conditions 
, specified by the facets. 

There is another important feature to be observed in this example. 
Since the values for length of service increase along a row, a value in 
one cell is more similar to a value in an adjacent cell than it is to a 
, cell farther away. The same kind of pattern will be true in a column and 

it will also be true diagonally across the diagram. This pattern reflects 
what Guttman calls the principle of contiguity, which is the basis for 
facet analysis. The principle is usually expressed in terms of correla- 
tions between observations in different cells rather than in terms of 
levels of values. 

Bastidc and van den Berghe 

To illustrate the features of facet design and analysis I 3ave 
been describing, I shall shortly turn to some extended examples. Before 
doing so, however, let me note here a key distinction between facet anal- 
ysis and factor analysis, since the two are sometimes confused. In factor 
analysis, factors are come upon after the data are collected. Quite the 
contrary is true of facet design. The facets must be chosen before data 
are collected. This is done, to put it brutally, as best one can. How- 
ever, there are aids upon which one can rely. One aid, of course, is a 
theory about the domain being studied - if one is available or can be 
built. Another way to go about it, which is exemplified in the article 
excerpted below, is to study the materials available concerning the do- 
main, looking for concepts which, when put together in the criss-crossing 
manner of the Cartesian space, will specify all the sets of conditions 
which one has found in his inspection of the domain. This latter method 
was used in the first example below. The example consists of excerpts 
from an article by Guttman published in 1959 in the American Sociological 
Review. This article takes data previously published by other authors, 
recasts them into a facet design, and subjects them to a facet analysis. 

Ti.e original article (written by the other authors) reported a study 
conducted within a domain of interest conceived in the usual intuitive 
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manner. Guttman’s study of their study shows clearly how the domain can 
be specified much more precisely, how a family of hypotheses flows dir- 
ectly from the facet design, and how the validity of the facets originally 
chosen can be checked in one coherent facet analysis. You should pay par- 
ticular attention as you read along to the manner in which the facet design 
illuminates the domain of interest well beyond that portion of the domain 
which was investigated by the original authors. 
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In a recent article, Bastide and van den Berghe describe four 
types, or subuniverses, of content in connection with interracial be- 
havior: stereotypes, norms , hypot hetical interaction, and personal 

interaction. They present some interesting empirical findings ‘in these 
areas, based on their Brazilian research, including a set of correla- 
tions among the four subuniverses. The purpose of the present paper is 
to suggest a structural theory for the observed interrelations among the 
four subuniverses. 

The four varieties of interracial behavior on which we are fo- 
cussing are described briefly by Bastide and van den Berghe. For our 
present purposes, it is convenient to restate and to capsulize the de- 
scriptions. Ihe following are definitions of the subuniverses of the 
four types: 

I. Stereotype: Belief of (a white subject) that his own 

group (excels -- does not excel) i.n comparison with 
Negroes on (desirable traits). 

II. Norm: Belief of (a white subject) that his own group 

(ought — ought not) interact with Negroes in (social 
ways) . 

III. Hypothetical Interaction: Belief of (a white subject) 

that he himself (will — wiTl not) interact with 
Negroes in (social ways). 

IV. Personal Interaction: Overt action of (a white sub- 
ject) himself (to — not to) interact with Negroes in 
(social ways). 

Underlinings and parentheses used in the above definitions are 
intended to indicate the semantic structure we are positing for inter- 
group behavior, and each will be explained. 

All four definitions have in common the fact that they involve 
a white subject and Negroes^ The phrase ’’with Negroes** occurs uniform- 
ly in each of the definitions, as does **a white subject.'* The inter- 
group behaviors of some pairs of groups other than ^ites and Negroes 
can be defined merely be replacing **' '*ite** and "Negroes** with the re- 
spective characterizations of the desired groups. It is convenient to 
think of specific groups, such as Negroes and whites, in developing our 
theory. ITie theory may be enlarged subsequently by letting the group:? 
vary according to some principle. 

The common or fixed elements indicate the universe of which the 
subuniverses are subsets. Since the subuniverses nevertheless differ 
among themselves, our first task is to ascertain the facets which de- 
termine those differences. 

The four definitions differ among themselves primarily on three 
facets, the elements of which are underlined in the definitions given 
above. Each definition concerns a type of behavior of a subject vis-a- 
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vis a type of intergroup behavior of a type of referent. Two kinds of 
behavior for the subject occur in the definitions: belief (a form of 

covert behavior) and overt action . Also, two kinds of referents occur: 
the subject's group and the subject himself . Similarly, two kinds of 
intergroup behavior are distinguished: comparative and interactive . 

Thus, each of the three facets occurs as a dichotomy. It is help- 
ful to list them and their elements in tabular form, assigning symbols to 
each for later use as in Table 1. 



TABLE 1. Facets on Which Subuniverses Differ 









c 


= Referent's 




= Subject's Behavior 






Intergroup 


A 


B = Referent 




Behavior 


h 


= belief 


b^ = subject's group 




= comparative 




= overt action 


b 2 = subject himself 


<=2 


=* interactive 



The capital letters A, B, and C denote the three facets, while the corre- 
sponding small letters with subscripts denote the elements of the respec- 
tive facets. 



Three dichotomous facets yield eight (=2x2x2) possible com- 
binations of three elements each, one element from each facet. That is, 
the Cartesian product of the three facets, which may be denoted by ABC, 
is a set of eight profiles, each profile having three components. Each 
profile defines a different subuniverse. But we have defined above only 
four subuniverses, or only a subset of ABC. We may tabulate this subset 
explicitly as follows: 



Subuniverse 



Profile 



I . Stereotype 


8jbjC 


II. Norm 


a^bjc 


III. Hypothetical Interaction 


aib^c 


IV. Personal Interaction 


ajbjc 
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A striking feature revealed by this tabulation is that the pro- 
files form a perfect scale. For each facet, a single cutting point in 
the rank order of the subuniverses suffices to divide the elements .ith 
subscript " 1 " from the elements with subscript ” 2 .“ For facet A, the 
cutting point is between III and IV; for facet B, between II and III; 
and for facet C, between I and II. If we arbitrarily call subuniverse 
I the left end of the scale, we have the rank order I < II < III < IV, 
or more verbally: Stereotype < Norm < Hypothetical Interaction < Per- 

sonal Interaction. The symbol "<” is used merely to signify that what 
is to the left of the symbol precedes what is to the right of the sym- 
bol in the rank order. 

Scale structures have been found in various kinds of empirical 
data -- in ranking people, social institutions, political units, and 
so on. We now find the same structure in ranking abstract concepts. 

In the empirical cases, only approximately perfect or quasi-scales are 
the rule, which sometimes raises troublesome problems of how to handle 
scale error. On the nonempirical , conceptual level, truly perfect 
scales are not at all inq)ossible, as exemplified above, with no problem 
of scale error. 

Semantic meaning for the rank order requires exploration. Accord- 
ing to scale theory, ordering the profiles also implies a formal ordering 
of the categories within each facet. The ordering I < II < III < IV im- 
plies formally the three simultaneous orderings: aj < a2, bx < b2, ci < 
C2» Do these further orderings have any common semantic meaning, formal- 
isms aside? If not, the formal scale of the four subuniverses need have 
no clear semantic meaning. 

A common meaning for the orderings can be suggested: they show 

in each case a progression from a weak to a strong form of behavior of 
the subject vis-a-vis Negroes. ’’Belief” is weaker than ’’overt action” 
in being passive rather than active. Referring to the behavior of 
’’subject’s group” is weaker than the subject referring to ’’himself,” 
insofar as the subject’s relations with Negroes are concerned. ’’Compar- 
ative” behavior is weaker than ’’interactive” behavior since it does not 
iii5)ly social contact; a comparison is more passive than interaction. 

Accepting this interpretation of the orderings within facets, we 
can say that the ordering of the subuniverses themselves also runs from 
weakest to strongest. ’’Stereotype” is the weakest form of intergroup 
subuniverse, ’’Personal Interaction” is the strongest form, while the 
other two subuniverses are intermediate in strength, in the indicated 
order. 



What of the profiles from ABC that were not indicated among the 
original four definitions? These can define further subuai verses . Thus 
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Two o£ the omitted profiles are a2bici and a2biC2. Each of these, 
according to its first two components (a2bx), concerns overt action (a2) 
of the subject with reference to the subject's group (bi). Presumably, 
each implies that the subject should activate or stimulate his group — in 
one case as to how it compares itself with Negroes (cj), and in the other, 
regarding interaction with Negroes (C2). The first case might be called 
"Teaching" and the second "Preaching." 

The remaining two omitted profiles are aib2Cx and a2b2Ci. Accord- 
ing to their last two components (b2Cx), each of these concerns the com- 
parison (r^) of the subject himself (£2) with Negroes as to desirable 
traits. The first profile might be called "Feel Superior" and the second 
"Act Superior," 

Six scales are possible, given the orderings aj < a2> bj < b2> 

Cl < C2 for the three facets. One way of bringing this out is to portray 
the entire universe as a partly ordered set, as in Figure 1 . 



The connecting lines between "levels" in the figure show the pairs of pro- 
files between which the inequality relation "<" holds. If abc and a'b'c* 
are any two different profiles, then abc < a'b'c* if and only if simultan- 
eously a<a*, b<b', c<c'. 

In a scalable series of levels, each profile differs from its 
predecessor on only one facet. Starting with Stereotype as Level I, 
this allows for only three possible profiles for Level II, for there 
are only three subscripts in Stereotype that can be raised from a " 1 " 



Figure 1 



Level I: 



Stereotype 



Level II: 



Level III: Hypothe 

Interaction 




Preaching 
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Ac 
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1 




Feel Superior 



Hypothetical 

Interaction 



Level IV: 
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to a 2.” Since each profile in Level II has only two subscripts of ’*1'’ 
that can be changed to a *'2," there are only two ways that a profile can 
move to Level III, so each has two lines branching down from it. For 
convenience, we have listed Hypothetical Interaction twice on Level III 
in the figure in order to avoid criss-crossing lines. There are only 
three profiles possible at Level III, since there are only three ways of 
Jiving one subscript equal to *’1” and the remaining two equal to ”2.” 
pie scales are the six continually descending possible pathways from 
tereotype to Personal Interaction in the diagram, along the lines run- 
ning from level to level. 

The universe is only partly ordered, for many pairs of profiles 
are not comparable. For example, we cannot say that the inequality •’<” 
holds between Norm and Act Superior, in either direction; while the 
latter exceeds the former on facets A and B, the reverse is true on 

facet C. Any two profiles of the same level are noncomparable for simi- 
lar reasons . 



Bastide and van den Berghe apparently carried out no tests of 
scalability for their data. It seems plausible, however, that each of 
their subuniverses should be at least quasi-scalable. For purpose of 
our present discussion, let us accept the hypothesis that numerical 
scores may be sufficient for studying the empirical interrlationships 
^ong the subuniverses. Let us accept the empirical correlation coef- 
ficients of the Brazilian study as a correct picture of the relation- 
ships among the subuniverses considered. 

The empirical product -moment correlations between the eight 
subuniverses of ABC for population P may be calculated. Our analysis 
above of the semantic structure of ABC provides a social-theoretical 
basis for predicting the structure of this empirical correlation 
matrix. One cannot presume to predict the exact size of each correla- 
tion coefficient from knowledge only of the semantics of universe ABC, 
but we do propose to predict a pattern or structure for the relative 

sizes of the statistical coefficients from purely semantic consTderiT- 
tions. 



Since the Brazilian data allow us to check our prediction only 
with respect to the intercorrelations of scores on four of the sub- 
wiverses (those earlier labeled I, II, III, and IV), we concentrate 
first on these. Our prediction is based on the following proposition: 

Hypothesis . Subuniverses ^oser to each other in 
semantic scale of their definitions v;ill also be closer statist 
tically. "■■■■■ — — — 



Statistical closeness is measured approximately (but not al- 
ways exactly, as we shall indicate belov/) by correlation coefficients. 
According to the contiguity hypothesis, generally Stereot)/pe should 
correlate more highly with Norm than with Hypothetical Interaction, 
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and almost certainly more than with Personal Interaction: r > r > 
rj jy. Similarly, we should have approximately r^^ > r ^ r ^ > 

Jjjl.r “f ^IV in *■ ’^iv II ^ ^'iv V '”'®s® exhaust ^the prekctionFthat 
possible or where dMering degrees of contiguity are de- 
fined by semantic rank order considerations for the subunJvwsL? 

BraziliaT'stnH^'^i correlation matrix reported by the authors of the 
t«™ IS equivalent to the presentation in Table 2. The struc- 

eo^re?f»- “ Virtually as predicted, lie larged 

correlations tend to be adjacent to the main diagonal, correspondiL to 

contiguous subuniverses - and Ly w^Foff ?o ?he 
in«eLe! "here semLtirdif?e^Lces 



TABLE 2. 



Empirical Intercorrelations of Scores 
on the Four Subuniverses 



II 



III 



IV 



Subuniverse 



Hypothetical Personal 

Stereotype Norm Interaction Interaction 



I. Stereotype 
II. Norm 

III. Hypothetical Interaction 
IV. Personal Interaction 



• 


.60 


.37 


.60 




.68 


.37 


.68 




.25 


.51 


.49 



.25 

.51 

.49 



An apparent slight exception to this structure is that r 
(= .49) does not quite exceed r (= .51), despite the fact tJat^“ 
semmtically III lies between II and IV. This need be no actual contra- 

contiguity hj^othesis, as should become evident in the 
plicit discussion of statistical distances below. Sampling error of 

explanationC^thrap^ar! 

ent aberration, but we prefer to ignore such ’’outs" for the purpose^of 

*TOm®SrR«^-i • s®l®ction of the 580 subjLts used 

“ described as "neither random nor pro- 
?• need not affect our structural theory. The rela- 

lute sizes of the coefficients might. Idiosyncracies of sampling and 

®“’’iects often can violently affect arithmetic 
means and other averages, as well as variances and other measures of 

coefficients are often harder to destroy or 
artificially, and the possible attenuation or disattraua- 
tion is even less likeiy to alter the pattern of correlations, since 
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such effects usually influence correlation coefficients by constants of 
proportionality. 

Had we empirical data for the complete matrix of correlations among 
all eight subuniverses, the validity of our structural theory as thus far 
developed could be checked further. The empirical results could be com- 
pared with the calculated results, and thus verify the adequacy of the 
structural theory. 

Failure of the results to check out could imply either or both of 
the following possibilities: the statistical structure deduced from the 
semantic structure was not appropriate; the semantic structure was faulty 
or incomplete. 

Note that the facet design, in contrast to the original limited 
design, lays out all the sets of conditions (or ”subuni verses") which are 
relevant to the kind of hypothesis chosen by the original authors. The 
facet design immediately produces an entire famil)' of hypotheses; namely, 
those comparing "favorableness*' in any two or more of the eight cells or 
subuniverses. The use of the principle of contiguity in the analysis 
makes an immediate check on whether the ordering of the elements in the 
several facets were properly chosen, and whether the facets and their 
elements were valid in the sense of supporting the prediction which the 
principle of contiguity makes. The principle of contiguity, in turn, 
is merely a direct inference from the meaning of ’'ordering" the elements 
within the facets. 

The facet design in the study quoted above clearly exemplifies 
another advantage of this tool. In the restatement by Guttman of the 
descriptions of the subuniverses (labeled in Roman numerals in the sec- 
ond paragraph of the excerpts) it is easy to see some kinds of facets 
which could be added so as to enlarge the domain of study. In fact, 
each phrase enclosed in parentheses in the descriptions of the sub- 
universes suggests another kind of facet which might be explored. The 
particular elements which might be chosen to compose these facets are, 
of course, up to the ingenuity and theoretical acumen of the investi- 
gator. 
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Salary Levels in the Civil Service 

Let us now turn to another application of facet design. Some 
time ago Guttman’s institute was given the task by the Israeli govern- 
ment of developing guides or rating sheets vhich could be used to 
establish the salary levels of jobs within the Israel Civil Service. 

After a great deal of interviewing and studying job specifications to 
determine what people felt was meritorious about the duties and skills 
demanded by the various jobs, Guttman and his colleagues decided upon 
the five facets labeled with capital letters on the next page. The 
next task was to develop a set of items based on these facets which 
could be used to evaluate the various jobs in the system. Once the 
facets and their elements were chosen, the construction of items for 

evaluating job level was straightforward. 

The facets described in the tabulation specify 3x4x3x3x3 
or 324 cells; that is, 324 types of jobs. Since the elements within each 
facet are ordered according to level of restriction on work, cells speci- 
fied by elements with larger subscripts are at higher levels than cells 
specified by elements with smaller subscripts. Accordingly, an instru- 
ment or rating sheet can be devised on which each item carries the 
specifications of some cell out of the 324. However, not all of the 
324 possibilities would be useful; as we have seen earlier, not every 
cell in the complete design can be said to be higher or lower than every 
other. Furthermore, one encounters practical difficulties which reduce 
the number of items which might be used, such as difficulties in phras- 
ing items, amount of time or fatigue required to answer the items, and 

so forth. 

The nature of the items finally selected is shown in the lower 
half of the tabulation. Each combination of small letters characterizes 
an item. For example, a^bi would sound something like, "A person in 
this job passes on information or materials without change according 
to detailed instructions provided him.” The item a 3 b 4 might read simply, 
’’Creates policy.” The item might read, ’’Periodically, the person 

in this job seeks advice from others of his own choosing cn whether his 



FACETS FOR JOB EVALUATION 



(by L. Guttman for Israel Civil Service) 
Types of restriction on work (facets) : 



B 

Guideline 



A 

V 

Freedom to 
change things 



a^^ transmit 
as is 

a2 modify 



a„ compose or 
^ create 



detailed 

instructions 

b2 general 
^ instructions 

bj policy 

b^ creates 
policy 



C 

Subordination 
to supervisor 



Cj receives 
■*’ instructions 

C2 consults 

c, independent 
(selects 
advisors) 



D 



Supervision 



d. continuous, 

^ direct 

d2 on completion 
^ of task 

d, periodical 
^ review 



Design of the items for job evaluation: 



E 

Level of 
other personas 
job 



mixed. 

62 high 

very high 



Originality 

and initiative Judgment 



Level of 
contact 



Level of 
expression 



Supervision 
over the job 
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actions are carrying out the policy directives under which he works.” 

Each line across the page in the lower half of the tabulation contains 
items which are at the same ” level”; items lower on the page represent 
jobs of higher level than items higher on the page. All told, the lower 
half of the tabulation contains 24 items distributed over twelve levels. 

Again, the principle of contiguity can be used to check the 
validity of this design. The principle of contiguity states that jobs 
described by adjacent cells of the facet design should be close together 
in their salaiy ranges. If it turns out in practice to be difficult to 
maintain this relation among salary ranges, then the evaluation scheme 
will have been shown to be invalid. 

The example just given shows how a facet design can be used to 
generate measuring instruments and also shows the fact that the facets 
the investigator uses for thinking his way through the problem do not 
restrict the manner in which the investigator need talk to the people 
he is studying. The types of items in the lower half of the tabulation 
are headed with titles which are in terms more familiar to personnel 
workers than are the titles of the facets. 

Communicatio n in Schools 

Let us now turn to another example. In a study concerning com- 
munication in high school faculties which I am at present pursuing, one 
of the hypotheses is as follows: 

Hypothesis 1, Given pairs of persons in disagreement at Time 
1, such pairs which remain in disagreement will be found at 
Time 2 not to have increased their communication, while pairs 
which increased their agreement will be found not to have 
decreased their communication. 

This hypothesis is embedded in a domain which (because of some 
other hypotheses) also includes factors of the social support an individ- 
ual receives for his opinion from other persons. The facets for this 
domain are shown on the next page. Instead of merely listing the facets 
with their elements, a form different from the earlier examples is used 



ERIC 



17 



BEHAVIORAL DOMAIN FOR HYPOTHESIS 1 

Given that respondent is an individual in strong disagreement with respon- 
dent2 at Time 1 in respect to the appropriate duties of the counselor, then: 

A B C 

respondent (who is a teacher receiving strong social support from 

respondent^ counselor . moderate 

administrator weak 



D 

another, where the other is receiving strong social support and is a 

moderate 

weak 

E 

teacher) 
counselor) 
administrator) 

R G 

of its frequency and in respect to general communication . 

teaching-topics communication . 

guidance communication . 



F 

reports his communication with the other at Time in terms 

the other at Time 2 
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in this diagram. The elements of the facets (labeled with capital letters) 
are embedded in a sentence which describes the kind of domain which is be- 
ing investigated. The capital letters A through G designate the facets; 
the letter R does not properly stand for a facet but rather for the “range” 
or dependent variable. It will be seen in the beginning of the sentence 
composing the diagram that certain possible facets are being held constant 
that is, this is really a subdomain of a conceivable larger domain. 

A great variety of sentences can be made from the sentence in the 
diagram simply by picking, tinder each capital letter, just one of the ele- 
ments listed. An entire family of hypotheses is thereby generated simply 
by performing the comparison called for by any two different sentences in 
respect to frequency of communication. It is clear that the diagram shows 
a great many questions which would remain unanswered if the investigator 
were to limit his attention to the hypothesis as originally stated. 

Selecting Trainees in Counseling 

Now let us turn to a final example. Another job which was put into 
the hands of the Israel Institute of Applied Social Research was to develop 
an interviewing procedure which would select teachers who were applying for 
training to become vocational guidance counselors. The following pages 
describe the procedure finally worked out. I am reproducing the instruc- 
tions for the interview, four forms for the interview, and two rating forms. 
You will not, however, find a list of the facets used. I leave inferring a 
list of facets from these materials as an exercise for the reader. 

In the examples given here, I have discussed some methods of anal- 
ysis which are primitive compared to what might be done with an electronic 
computer. Fortunately, methods of analysis based on the logic of facet 
design have recently been developed for use with a computer. These develop- 
ments are due to James Lingoes, of the University of Michigan, working in 
close collaboration with Guttman. You will find references to this import- 
ant work in the bibliography. 

NOTE: The facet designs for (a) job classification and (b) inter- 
viewing applicants for training in counseling are taken from informal mate- 
rials distributed by Guttman in a seminar held some years ago at the Uni- 
versity of Illinois; they should not be cited or quoted as representine 
current practice in Israel. ^ 
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The Government of Israel 
The National Institute for Vocational Guidance 



Interview of Counseling Teachers 
Instructions for the Interview 



Systematic interchange of tasks among the members of the acceptance 

committee, 

1) Every member of the committee will serve in one of the following 

tasks in each interview: (a) interviewer, (b) rater with form 

and (c) rater with form ”B.” 

2) The tasks of each interviewer will be interchanged at the end of 
each interview. The committee member who was an interviewer at 

a certain interview will serve as a rater at the following inter- 
views, until his turn comes again to serve as an interviewer. 

3) A member who was a rater with form ”A” at a certain interview 
will rate the next interview with form and vice versa (until 
his turn co^mes again to be an interviewer) . 

1 

b) The 4 forms of the interview . 

1) Attached herewith are 4 parallel forms of an interview each of 
which includes 9 questions. The first interviewer employs form 
No. 1, the second employs form No. 2, etc. The fifth returns 
to form No. 1 and so on. 

2) Before the beginning of each interview, the rater must mark on 

his rating form, at the proper place, which form of interview 

was used. 

3) Before the beginning of the interview, each interviewer has to 
take care that the rater marks properly on his form the type 
of interview that is being used. 

c) Filling out the rating forms . 

1) At each interview, half of the raters will fill out rating form 

"A,” and the other half will fill out form *'B.‘» If the number 

of raters is not even, it is necessary to arrange that the form 
will be filled out evenly in the course of the whole set of 
interviews . 

2) Before each interview it is necessary to take care of the inter- 
change of tasks among interviewers and raters and also among 
raters in accordance with the instructions of paragraph *’a*’ 
above. 
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Interview of Counseling Teachers 
Form 1 



1) l«iat are the things in your present work that you are satisfied 
with, and vdiy? 

2) What do you see as the main function of the teacher? 

3) Describe the relations that have developed between you and the 
children with vdiom you worked last year. 

4) Tell me about your work with children in general. 

5) In which things was your work with pupils successful and in which 
were you less successful? 

6) To wh5t extent do you have, according to your opinion, the necessary 
requirements for a good teacher? 

7) Describe your past achievements in teaching, 

8) To what extent did your class achieve the curriculum requirements? 

9) Tell about a child whose specific personal problem you have treated. 
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Interview of Counseling Teachers 
Form 2 



1) Tell about the problems you have encountered in your work. 

2) IVhat are the problems that you may encounter in couseling work, 
according to your opinion? 

3) Did you have an occasion to know children who needed counseling 
especially? Describe your relations with them. 

4) Tell about your work with children in general. 

5) Did you have an occasion to know children who need counseling? 

Can you describe their problems? 

6) To what extent, do you think, you have the necessary traits of 
a good counselor? 

7) Describe the teaching achievements you had in the past. 

8) On what did it depend that your class did not achieve in the cur- 
riculum more than it did? 

9) Concerning personality, what differences did you find between the 
children that you tau^t and rural children, urban children, and 
children from other institutions? 
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Interview of Counseling Teachers 
Form 3 

1) What are the things in your present work that you are not satisfied 
with, and why? 

2) What are, in your opinion, the characteristics of a good teacher? 

3) Describe by what method you succeed in gaining the confidence of 
the children with whom you work. 

4) Tell about your work with children in general. 

5) In which things did you succeed in your work with pupils, and in 
which things have you been less successful? 

6) What is it that gives you satisfaction in your work as a teacher? 

7) Describe your past achievements as a teacher. 

8) To what extent did your class achieve the curriculiim material? 

9) Tell about a child whose specific personal problem you have treated. 
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Interview of Counseling Teachers 
Form 4 



1) Tell about your work. 

2) What are, in your opinion, the characteristics of a good counselor? 

3) Describe the relations that have developed between you and the 
children with idiom you worked last year. 

4) Tell me about your work with children in general. 

5) Did you ever have ati occasion to gst acquainted with children who 
needed counseling? Can you describe their problems? 

6) What do you find especially interesting in your work as a teacher? 

7) Describe your previous achievements in teaching. 

8) Upon what did it depend that your class did not achieve some of 
the curriculum material? 

9) Concerning personality, what differences did you find between the 
children that you taught and rural children, urban children, and 
children from other institutions? 
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Interviewee 



Place 



Form of Interview 



Rating Form of the Interview 
Type A 

Name of Rater 
Date 

12 3 4 



No» of question 



123456789 



a. 


Facts only 


1 






Mainly facts 


2 






Many opinions 


3 






Opinions only 


4 




b. 


Achievements only 


1 






Mainly achievements 


2 






Achievements and problems 


3 






Mainly problems 


4 






Problems only 


5 






Neither of these 


6 




c. 


Almost all about himself 


1 






A lot about himself 


2 






Little about himself 


3 






Almost nothing about 
himself 


4 




d. 


Almost only about the 
children with whom 
he worked 


1 






Much about the children 
with whom he worked 


2 






Little about the children 
with whom he worked 


3 






Not at all about the 
children with whom 
he worked 


4 




e. 


His description of the 
children 








absolutely positive 


1 






mainly positive 


2 






neutral 


3 






mainly negative 


4 






absolutely negative 


K 





Additional remarks: 



Rating Form of the Interview 
Type B 



Interviewee 

Place 



Name of Rater 
Date 



Form of Interview 



1 2 3 



No. of question 



Answer — expansive with 
respect to question 
To the question but also 
going beyond 
Restricted with respect 
to question 
Evades the questio n 

Much hesitation 
Careful 
Unhesitating 
Exaggerated confidence 

Expresses himself with 
difficulty 

E3q>resses himself with 
some difficulty 
Fluent (without any 
difficulty) 
jxaggerated fluency 

E}q}resses himself very 
unclearly 
Quite unclearly 
Clearly 
Very clearly 

Special syn^toms of nerv 
ousness (like biting 
the nails, etc.) 

Usual symptoms of nerv- 
ousness but to a 
conspicuous extent 
Usual symptoms of nerv- 
ousness to a limited 
extent 

Without any symptoms of 
nervousness 
Expressionless 

Description of the 

symptoms of nervousness: 







Additional remarks: 
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THEORY OF DATA 

We can conveniently think of research as having five phases. The 
first phase is that of selecting a universe of potential observations — 
or, in our earlier terms, a domain of investigation. The criterion for 
choosing a domain for investigation (which, of course, is different from 
choosing facets to specify the domain) is simply that of personal prefer- 
ence.' 

The second phase is that of recording observations made within 
the selected domain. In this phase one must choose what observations to 
make. It is at this stage that facet design is especially helpful. One 
does not wish to find that he has omitted to make observations on a vital 
part of the domain, nor does he wish to find that he has wasted his time 
being redundant. 

The third phase is to convert one*s observations into data. If 
this sounds like an odd statement, let me give a brief example. Suppose 
that we have recorded the fact that John was not admitted to Rutgers. 

I can think of at least four conclusions which could be drawn from this 
observation; (1) John is not smart enough to get into Rutgers, (2) John 
is too far off to the side of genius for Rutgers* screening test to 
recognise, (3) Rutgers* standards are too high for John, (4) Rutgers is 
too stupid to recognize a good man when they see one. Two of these in- 
terpretations cell us opposite things about John, and two of them tell 
us opposite things about Rutgers. Into which datum should we convert 
our observation? If the information that John was not admitted to Rutgers 
appeared on a questionnaire containing other items about John, it would no 
doubt be used to assess the characteristics of John. If it appeared on a 
questionnaire sent out to people who had been and had not been admitted 
to Rutgers, it would probably be used to come to some conclusion about 
Rutgers. In brief, the kind of data we make out of our observations is 
not a foregone conclusion, but rather a choice which the investigator 
must make — a choice, in fact, which he does make, consciously or 
unconsciously. 
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The fouith phase is to take the data and classify the individuals 
or objects to which the data refer in some way which will simplify think- 
ing about the data. This process is often called scaling . One technique 
often used is simply to add up the number of data which are interpreted 
as pointing in a certain direction. Very often this phase is followed by 
a fifth phase which consists of seeking relations which might exist be- 
tween one classification of data or another classification; in other 

words, seeking relations among variables. 

The theory of data deals with the stages of making data out of 
observations and of making variables out of data. Although over the 
years a great amount of thought has gone into various aspects of these 
phases of research, it is only recently that a scheme has been proposed 
(by Coombs) which promises to encompass all the facets encountered in 
these problems. If this seems too strong a statement, let me say at 
least that Coombs has proposed some facets which seem to be encountered 
vdienever we convert observations into data and whei:^ver we convert data 
into variables, and that these facets enable us to compare one with an- 
other the great variety of methods now in existence. Furthermore, Coombs* 
theory of data systematizes the field in such a way that we can use it 
to tell ourselves how to invent new methods of collecting data and how 
to choose appropriate methods for analyzing data gathered by old or new 
methods. I want to carry my explanation in this paper far enough so 
that you can see how the theory can enable you to invent some new methods 

of data collection. 

Some people feel that the method of data collection is of little 
importance. Let me give a small example of a way in which one can come 
to quite different conclusions from identically the same actual situation 
because of different methods of data collection. Let us suppose that 
there are three candidates among whom one is to be elected. Suppose that 
ten voters prefer the candidates in the order ABC as shown in the tabula- 
tion below, ten others prefer them in the order BCA and a third ten prefer 
them in the order CAB. The chairman takes a vote and finds that the 
candidates have fallen into a three-way tie. Thereupon the chairman 
adopts a run-off method and asks the voters first to choose between 
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Voter Preference 
type order 



1 A to B to C 

2 B to C to A 

3 C to A to B 

candidates A and B. As we see from the tabulation, the first and the 

third groups of ten voters prefer A to B, while only the second group 

of ten voters prefers B to A* B is therefore eliminated, and you can 
see that C would get twenty votes to A’s ten in the run-off between A 
and C. Thus, C wins. 

But suppose that the chairman had first decided to pit B against 
C. The first and second grot 5 >s of ten would have voted for B over C 
while only the third group would have voted for C over B. Thus, C would 
have been eliminated. In the run-off between A and B, A would have won! 
Similarly, B would win the election if the chairman were to begin with a 
contest between A and C. In brief, the winner of the election in this 
case depends entirely upon how the chairman decides to collect the data 
concerning the voter preferences. (It should be noted also that this 
example does not depend upon having equal groups of voters. The same 
conclusions can be reached if any two groups of voters outnumber those 
in the third group.) 

The theory of data begins with the interpretation that any datum 
can be represented by a relation on a pair of points (or on a pair of 
pairs of points). For example, if we are interested in the character- 
istics of John we can call John a point representing an ’’individual” 
and Rutgers a point representing an object or a ’’stimulus.” We can then 
represent the observation that John was not admitted to Rutgers by say- 
ing the relation between the two points is that the ’’individual” point 
is on the ’’negative” side of the ’’stimulus” point. If we are interested 
in evaluating Rutgers, we would call Rutgers the individual point and 
John the stimulus point. 

The theory of data is built principally on only three facets, 
each one of which contains only two elements. The first facet asks 
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whether the datum is to be represented as a relation on just one pair of 
points or whether it is to be represented by a relation on two pairs of 
points; that is, by a relation on two distances. The second facet asks 
whether the datum is to be represented by points from one set or from 
two sets; that is, points from a set representing (a) only individuals 
or only stimuli, or (b) points from both sets. The third facet asks 
whether the relation is an order relation or a proximity relation. 

Coombs lays out these facets in a form similar to that shown in the dia- 
gram headed ’’The Data Quadrants.” The elements of the first two facets 
specify the ’’quadrants” and the elements of the third facet correspond 
to the ”a” and ”b” within each quadrant. Some examples of data are 
given within each of the quadrants of the diagram. 

It turns out that most methodologists have preferred to collect 
data by methods customarily interpreted as belonging in Quadrant II, 
Methods typically used to collect data for this quadrant are the mental 
test methods, attitude questionnaires, ’’pick one,” rating scale methods, 
magnitude estimation, and others. Quadrant III has received increasing 
attention in recent years, while Quadrant IV has had so far the least 

attention of the four. In this paper I shall limit myself to telling 
you about Quadrant I. 

Quadrant I provides the model for data which are interpreted as 
meaning that an individual prefers object A to object B. Of course, we 
need not limit ourselves to asking an individual about only two objects 
at a time. For example, we can ask John, ’’What is your rank-order pref- 
erence among Rutgers, Harvard, Princeton, and Yale?” Sometimes in a 
conversation we ask a person about his preferences among three or four 
objects and then, if we feel we do not have enough information, we ask 
him about a different assortment of three or four objects. We might 
go on to ask John, ’’Well, how do you fell about Rutgers, Princeton, 
Michigan, and Oregon?” In other words, we can present the individual 

with different assortments of objects among which we want him to tell 
us his pa?eferences , 
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THE DATA QUADRANTS 



Tw sets : both individuals and stimuli 



One pair of points 
Quadrant II: Single Stimulus 



Two pairs of points (distances) 



1 . 



Qlla (ordinal) : John exceeds 
Rutgers. For example, 
John passes Rugers* 
requirements , 

Qllb (proximity): John is 
closer to Rugers (from 
either direction) than 
some criterion distance. 
For example, John»s abil- 
ity is close to the aver- 
age at Rutgers, 



Quadrant I : Preference 

QIa (ordinal): The distance 
from John to Rutgers is 
less than that from John 
to Harvard. For example, 
John’s preference for 
Rutgers is greater than 
his preference for Harvard. 

Qlb (proximity) : not collected. | 



0^6 set : individuals or stimuli 

One pair of points Two pairs of points (distance) 



Quadrant III: Stimulus comparison 

Qllla (ordinal): Tuition at 
Rutgers is higher than 
at Harvard. 

Qlllb (proximity) : Tuition 
at Rutgers is about the 
same as at Harvard. 



Quadrant IV: Similarities 

QlVa (ordinal): The difference 
between tuition at Rutgers 
and Harvard is less than 
the difference between 
Rutgers and Princeton. 

QlVb (proximity) : no models 

for analysis yet available. 
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We need not ask the individual for a rank-order. Sometimes we 
might ask a young man, "To which colleges out of this list did you apply?" 
If he has picked three out of the list we can interpret this behavior as 
telling us that those three colleges were closer to his ideal than the 
remainder on his list. These examples suggest quite a few different wa} i 
of collecting data. First, we can be concerned with n total objects. 
Second, we can present £ of these n objects to the individual at a time. 
Third, we can ask him to pick out of the £ presented to him as most 
preferred, or we can ask him to order k out of the £ presented to him. 

These facets within Quadrant I enable us to lay out an entire grid of 
methods of collecting data. This grid is called by Coombs the "search- 
ingness structure" and is displayed on the next page. This chart as 
shown here has no certain number of rows or colums because n is unspeci- 
fied. The quantity n is, as I said before, the total number of objects 

or stimuli about which one wishes to get information from his subjects. 

The number of stimuli vAiich can be presented at a time are arrayed across 
the top of the chart and the numbers of those stimuli \diich the investi- 
gator asks the subject pick or order are arrayed down the left side of 

the page. Every cell in the diagram represents a particular way one 
might go about getting preference information from subjects. 

Of all these possible methods, only four are well known. The cell 
near the middle left side of the diagram labeled "1" is one version of 
the method of single stimuli; one presents all the stimuli in which one 
is interested and asks the subject to "pick one." At the top of that 
column, the cell labeled "2" represents the method of rank order; that 
is, "order n-1 of n." (This is equivalent, of course, to "order n of n.") 
At the right side of the chart, the cell labeled "3" represents the 
method of pair comparisons; that is, "pick 1 of 2," which is equivalent 
to "order 1 of 2." The cell labeled "4" is the method of triads,. much 
less used than the other three; that is, the n stimuli are presented 
to the subject three at a time and he is asked to order two of the three, 
which, of course, is equivalent to ordering all three in each presentation. 
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THE SEARCHINGNESS STRUCTURE 



Number of stimuli in a presentation 






Beginning with only the two facets which determine the searching- 
ness structure as displayed here, it is clear that a myriad of new ways 
have been laid out for collecting data. Furthermore, a little thought 
will show there are other facets which might be added which would generate 
even more varieties of ways of collecting data, very few of which have as 
yet been explored in empirical work. In recent years some work has been 
done with a few of the ’’new” cells in the chart and it has been amply 
demonstrated that some of the new methods are indeed considerably more 

"searching” than the traditional methods. 

The searchingness structure, by the way, demonstrates again the 
power of the facet idea. Psychologists went along for decades working 
vdth the methods of single stimuli, rank order, and pair comparisons, 
and with occasional unsystematic forays into the method of triads; it 
was not until Coombs looked hard at the ways in which the conditions of 
data collection could vary that the simple chart of the searchingness 
structure was laid out and it immediately became evident that a great 
array of methods of data collection lay as yet unexplored. 

The searchingness structure itself is only one example of the 
kind of idea which is generated by the basic definition of data into 
eight simple types. Another important idea is the assessment of con- 
sistency and transitivity by means of some of the methods laid out in 
the searchingness structure. Still another is the ’’unfolding technique, 
which is crucial in assessing the relations subjects perceive among 
objects after you obtain from them their preference orders. 

But there is not space to go on talking about the theory of 
data here. Instead, before coming to an end, let me illustrate only 
one kind of thing which can be done with the concepts generated from 
Quadrant I of the data types. Reproduced below is a passage from 
Social Psychology by Newcomb, Turner, and Converse. The study des- 
cribed made use of the method of triads and the unfolding technique. 

The unfolding technique was elaborated to produce an index of cognitive 
similarity called "collinearity.” 
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anoth6r»'’^Thfrf ^ "f ^ *° °"® listener than to 

P®5® '^e e number of reasons, of course, but surely one 

x7?S^ “xtf^S °"® P^son to another 

if ih! ♦i* ^ ^ the two persons pay attention to the same aspects 

f the thing they are talking about. A person lAo pays attenti on'to 
certain q^lities or aspects of environmLtal o^ Ic^fin SeScfto 

aspects has a distinctive "cognitive structure." if 
we find two people paying attention to the same features or thread in 

with similar cognitive structures and we would predict that the trans- 
mssion of meting from the one person to the o?her would be morf“L 

Sith diisimilar’^ei^tf persons attempting to converse 

Ibis hypothesis was tested by 
Runkel (1956) in a study examining the transmission of meaning from^ 
instructors to college students. meaning irom 

are to experiment was simple. If students 

?he subi^it^tei fr’f T statements about 

i matter the teacher prefers; for example, they must be able 

to pick out pretty accurately the statements on a multiple choice test 

av«e "right." The studLt need not 

g^^with the statements which the instructor favors; he need only be 

iudLrstatemL?s ®"®'‘ statements. Presumably the instrwtor 

judges statements accoru ng to certain characteristics or "dimensions" 

will student. The hypothesis, then, is that meaning 

will get more quickly or more fully from teacher to student if the tvo 

S^temmts characteristics or dimensions of the 

'’® *^’’® ®^®® >*«" they are paying attention to ' 
different dimensions — and this will be true regardless of whether 
teacher and student agree on which statements are best. 



ta analogy may make this more clear. Figure 2 below shows a 
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Suppose that you walk into this room looking for someone of your ovm age 
with whom to talk; if so, you would pay attention primarily to the east 
and west halves of the room because the old people are mostly in the east 
half and the young people in the west half. That is, you would pay atten- 
tion primarily to the ’’east-west dimension.” On the other hand, if your 
chief interest was to find someone of the opposite sex (whichever your 
own), you would pay attention primarily to the north and south halves of 
the room — the ’’north-south dimension.” 

Suppose you were in one comer (any comer) of the room with a 
friend and he said, ”I think I will look for some people more interesting 
than this bunch.” In order to predict the direction in which he would 
stroll away, you would have to know the dimension by which he judged 
interestingness. But you might want to be helpful to your friend and 
you might suggest to him one or two persons with whom he would like to 
converse. If you took it for granted that he would move in the same 
direction you would move and if you were right in this assumption, then 
he would find your suggestions to be good ones. If you were wrong about 
your assumption — if your ’’cognitive structure” about the interesting- 
ness of the people in the room was different from his — then he would 
not enjoy your suggestions. 

You and your friend would not need to prefer the same kind of 
conversationalists in order to comprehend the preferences of each other. 

If you were twenty years old and he were fifty, you might suggest to 
him that he strike up a conversation with some of the people in the 
east half of the room; even though you might yourself prefer to talk 
with young people, you might easily accept the idea that he would pre- 
fer to talk with older people. But you would both be using the east- 
west dimension as a basis for understanding the preferences of the 
other person. 

We can just as well think of Figure 2 as being a field of state- 
ments about the realm of psychology as covered by a course in college. 

In getting ready for his experiment, Runkel constructed statements 
about the realm of psychology which could be imagined to be scattered 
over a field similar to that of Figure 2 (but no doubt having more than 
two dimensions). From the preferences among five statements expressed 
by students and instructors, the rank order of each person’s prefer- 
ences was worked out. The analogy here would be walking through the 
room, making judgments about whether one person or another was the more 
interesting conversationalist. You could very well end by rank order- 
ing quite a number of the persons from the most to least interesting. 

By using a geometric model (Coombs, 1964) it was possible to 
estimate whether, on the one hand, a teacher and his student were 
probably judging the statements about psychology on the same dimensions 
or, on the other hand, whether they were using different dimensions. 

If the instructor and student were basing their preferences among the 
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statements on the same dimension, this was a rough index of their ”cogni- 
tiye similarity” about psychology; if they were using different dimensions, 
this indicated cognitive dissimilarity. 

^alities of statements about psychology are not at all as easy 
to perceive as age and sex of human beings in a room. It is not easy to 
discern the dimensions of preference of another person concerning compli- 
cated matters such as opinions about psychological topics. The hypothesis 
in the experiment was that students who showed cognitive similarities to 
their instructors in regard to the statements would be better able to 
catch on to the preferences of their instructors about such statements, 
while students with cognitive structures dissimilar to those of their in- 
structors would have a harder time anticipating the statements their in- 
structors would prefer. Consequently, the prediction was that the "cog- 
nitively similar” students would obtain higher grades on quizzes written 
and graded by their instructors than would the "cognitively dissimilar" 
students . 

The results con 5 )uted for those subjects who were stable in their 
opinions (both in respect to their instructors and over the time period 
of a semester) supported the prediction and are summarized in the table. 
Because grading is different in level and range from class to class, the 
quiz scores were converted to "standard" scores within each class; that 
is, they were recomputed so that the standard deviation within each class 
became the unit for scoring. These standard scores are the ”z-scores" 
mentioned in Table 3 below. The mean z -score for students with cognitive 
structures similar to those of their instructors was significantly higher 
(P<.05) than the mean for students with cognitive structures dissimilar 
from their instructors. 

Table Z, Difference between z-scores on quizzes for students whose cogni- 
tive structure about psychology was (a) similar to that of their in- 
structor and for those whose cognitive structure wa¥ fb^ dissimilar 
to that of their instructor. 





(a) 

Similar 


(b) 

Dissimilar 


top 2 -score 


2.77 


1.74 


Mean z-score 


0.60 


-0.25 


Lowest z-score 


-1 . 16 


-2.56 


Standard deviation 


1.38 


1.17 


Number of students 


17 


19 
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A number of futher into the data. No evidence 

examined in this e^eriment "oncernte^ cognitive similarity, 

was found to cast doubt upon the hypothesis concerning cog 

Winston, 1965* Pp. 191-193. 
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